Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pass in transcript message to send_speech_to_output #340

Merged
merged 7 commits into from
Aug 4, 2023

Conversation

ajar98
Copy link
Contributor

@ajar98 ajar98 commented Aug 4, 2023

update the transcript as the bot message is being spoken - now, we don't have to update the transcript on cut-off, it will already reflect what has been said so far.

old world implementation:

  • put the full message in the transcript (so that a response to an interrupt doesn't repeat itself, it needs some notion that something has been said at all)
  • after it has been said, update the message to what was actually spoken on the call

this is failing spectacularly for cases when the agent sends multiple messages in a row to the AgentResponseWorker, since we were updating the wrong "last bot message" in the transcript

new world implementation:

  • create an empty transcript message
  • attach it to the transcript
  • update it through the course of send_speech_to_output (in the SynthesisResultsWorker)
  • send it to the events manager after send_speech_to_output is finished

@ajar98 ajar98 marked this pull request as ready for review August 4, 2023 22:44
Copy link
Contributor

@HHousen HHousen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@ajar98 ajar98 merged commit 4ef940c into main Aug 4, 2023
4 checks passed
m5a0r7 pushed a commit to m5a0r7/vocode-python that referenced this pull request Oct 19, 2023
* pass in transcript message to send_speech_to_output

* publish to events manager

* remove commented code

* move transcript add to later in send_speech_to_output

* one more fix

* adds note on azure synthesizer

* adds comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants